Sometimes we want to put a threshold function at the output of a layer. This can be for a variety of reasons. One of them is that we want to summarize the activations into binary values. This binarization of activations can be useful in autoencoders. However, thresholding poses a problem during backpropagation. The derivative of threshold functions is zero.

Legacy autograd function with non-static forward method is deprecated. Please use new-style autograd function with static forward method.的錯誤，因此需要一些調整。詳細可參考下方的程式碼。

Deep Learning is part of the Machine Learning family that deals with creating the Artificial Neural Network (ANN) based models. ANNs are used for both supervised as well as unsupervised learning tasks. Deep Learning is extensively used in tasks like-object detection, language translations, speech recognition, face detection, and recognition..etc. Let's create our First Neural Network with PyTorch- In this article, I am going to explain how to create a simple Neural Network (deep learning model) using the PyTorch framework from scratch. If you are not familiar with PyTorch, you can read my article here that throws light on fundamentals building blocks of PyTorch.